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ABSTRACT 

In this work we propose novel decision feedback (DF) detection al- 
gorithms with error propagation mitigation capabilities for multi- 
input multi-output (MIMO) spatial multiplexing systems based on 
multiple processing branches. The novel strategies for detection ex- 
ploit different patterns, orderings and constraints for the design of 
the feedforward and feedback filters. We present constrained mini- 
mum mean-squared error (MMSE) filters designed with constraints 
on the shape and magnitude of the feedback filters for the multi- 
branch MIMO receivers and show that the proposed MMSE design 
does not require a significant additional complexity over the single- 
branch MMSE design. The proposed multi-branch MMSE DF de- 
tectors are compared with several existing detectors and are shown 
to achieve a performance close to the optimal maximum likelihood 
detector while requiring significantly lower complexity. 

Index Terms — MIMO systems, spatial multiplexing, decision 
feedback detection, constrained optimization. 

1. INTRODUCTION 

Multiple transmit and receive antennas in wireless communication 
systems can offer significant multiplexing 1 1 . 6 1 and diversity gains 
[3]. In a spatial multiplexing configuration, the system can obtain 
substantial gains in data rate. The capacity gains grow linearly with 
the minimum number of transmit and receive antennas, and the trans- 
mission of individual data streams from the transmitter to receiver 
|1|. In order to separate these streams, a designer must resort to 
MIMO detection techniques. The optimal maximum likelihood (ML) 
detector can be implemented using the sphere decoder (SD) algo- 
rithm [4|. However, the computational complexity of this algorithm 
depends on the noise variance, the number of data streams to be de- 
tected and the signal constellation, resulting in high costs for low 
signal-to-noise ratios (SNR), large MIMO systems and large con- 
stellations. The complexity requirements of the ML detector and 
the SD algorithm have motivated the development of numerous al- 
ternative strategies for MIMO detection. The linear detector 0, 
the successive interference cancellation (SIC) approach used in the 
VBLAST systems |6| and the decision feedback (DF) detectors 171 - 
1 8 1 are techniques that can offer an attractive trade-off between per- 
formance and complexity. An often criticized aspect of these sub- 
optimal schemes is that they typically do not achieve the diversity 
of the ML and SD algorithms. This motivated the investigation of 
detectors such as lattice-reduction-based schemes ||9] |101 and calls 
for new cost-effective algorithms with near-ML or ML performance. 
In this work we propose novel DF detection strategies for MIMO 
spatial multiplexing systems based on multiple processing branches 
and error propagation mitigation. Prior work on DF schemes in- 
cludes the DF detector with SIC (S-DF) (7J [8) and the DF receiver 
with PIC (P-DF) |TT), combinations of these schemes fTT1[T2l[T3l 
and mechanisms to mitigate error propagation B14I 1151 . The pro- 
posed detector employs multiple feedforward and feedback filters 



and yields multiple decision candidates. The proposed structure ex- 
ploits different patterns and orderings and selects the candidate and 
branch which yield the estimates with the highest likelihood. We 
present constrained minimum mean-squared error (MMSE) filters 
designed with constraints on the shape and the magnitude of the 
feedback filters for the multi-branch MIMO receivers. We show that 
the proposed MMSE design does not require a significant additional 
complexity since it relies on similar filter realizations but with dif- 
ferent constraints on the feedback filters. The proposed multi-branch 
MMSE DF detectors are compared with several existing detectors 
via simulations. The main contributions of this work are as follows: 

1) Multi-branch MMSE decision feedback detectors ; 

2) MMSE filter expressions with shape and magnitude constraints; 

3) A study of the proposed and existing MIMO detectors. 

2. SYSTEM MODEL 

Let us consider a spatial multiplexing MIMO system with Nt trans- 
mit antennas and Nr receive antennas, where Nr > Nt- At each 
time instant [i], the system transmits Nt symbols which are orga- 
nized into a Nt X 1 vector s[i] — [si[i], Sz[i], ..., sjv T [i]] 
taken from a modulation constellation A = {ai, a?, . . . , ajv}, 
where (-) T denotes transpose. The symbol vector s[i] is then trans- 
mitted over flat fading channels and the signals are demodulated and 
sampled at the receiver, which is equipped with Nr antennas. The 
received signal after demodulation, matched filtering and sampling 
is collected in an Nr x 1 vector r [i] — [n [ i] , T~2 [i] , • • • , rN R [i] ] 
with sufficient statistics for detection and given by 



r[i] = Hs[i] +n[i]. 



(1) 



where the Nr x 1 vector n[i] is a zero mean complex circular 
symmetric Gaussian noise with covariance matrix _E[n[i]n H [i]l = 
<JnI, where E[-] stands for expected value, (•) denotes the Her- 
mitian operator, a^ is the noise variance and I is the identity ma- 
trix. The symbol vector s[i] has zero mean and a covariance matrix 
£'[s[i]s H [i]] = <xf J, where a\ is the signal power. The elements 
h nR ,n T of the Nr x Nt channel matrix H are the complex channel 
gains from the 7iTth transmit antenna to the riRth receive antenna. 



3. MULTI-BRANCH MMSE DF DETECTORS 

In this section, we detail the proposed multi-branch MMSE deci- 
sion feedback (MB-MMSE-DF) structure for MIMO systems. The 
proposed MB-MMSE-DF scheme, shown in Fig. 1, employs mul- 
tiple signal processing branches with appropriate shape constraints 
that modify the design of both feedforward and feedback filters. The 
detector exploits different patterns and orderings for the design of 
the feedforward and feedback filters. The aim is to mitigate the error 
propagation and approach the performance of the optimal ML detec- 
tor. The proposed MB-MMSE-DF scheme can achieve the full di- 
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versity available in the system by increasing the number of branches 
and, therefore, the number of candidate symbols prior to detection. 
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where the iVr x -At shape constraint matrix is Sj : i, Vj : i is the re- 
sulting Nt x 1 constraint vector and f c , l is a feedback filter without 
constraints on the magnitude of its squared norm. 

By resorting to the method of Lagrange multipliers, computing 
the gradient vectors of the Lagrangian with respect to Wj t i and / ; , 
equating them to null vectors and rearranging the terms we obtain 
for j — 1, . . . , Nt and I — 1, . . . , L 



wj,i ^RT^ + Qfu), 



(6) 

(7) 



(8) 



f,. 



Fig. 1. Block diagram of the proposed nhulti-hraln ch DF detector. 

JVj x 1 

The MB-MMSE-DF employs multiple feedforward and feed- 
back filters such that it can obtain different local maxima of the like- 
lihood function associated with the ML detector. In order to detect 
each transmitted data stream, the proposed MB-MMSE-DF detector 
linearly combines the feedforward filter Wj.i corresponding to the j- 
th data stream and the l-th branch with the received vector r\i], sub- 



fj,i = Pj^jAQ w j,i ~ tj) + (I- u j,i) v j,h 
where 

is a projection matrix that ensures the shape constraint Sj t i and 
f3j,i — (1 — otj 7 i)~ is a factor that adjusts the magnitude of the 
feedback, < j3jj < 1 and aj : i is the Lagrange multiplier. The 
relationship between /3jj and 7^; is not in closed-form even though 
we have /?,y = and fijj — 1 for jj t i = (standard linear MMSE 
detector) and 7^; = 1 ( standard MB-MMSE-DF detector), respec- 
tively. The Nr x Nr covariance matrix of the input data vector is 
R = E[r[i\r H [i\], Pj = E[r[i]s*[i]], Q 



E[rm>, H [q],wd 



tj = E\s°i[i]s*j [i]] is the Nt x 1 vector of correlations between 



tracts the remaining interference by linearly combining the feedback s°,i [i] and s* [i]. Substituting Q into @ and then further manipu- 
filter / ■ , with the N T x 1 vector of initial decisions s° , [i] obtained lating the expressions for v j>t = , we arrive at 



from previous decisions. This input-output relation is given by 



z jt i[i\ =w 

i = i 



H r-i 



- ff,iSj,i[i], 
N T and / = 1, 



(2) 



where the input to the decision device for the ith symbol and j-th 
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(10) 



stream is the L x 1 vector z, 



The number 



of parallel branches L that yield detection candidates is a parameter 
that must be chosen by the designer. In this context, the optimal or- 
dering algorithm conducts an exhaustive search L = Nt\ + 1 and is 
clearly very complex for practical systems when Nt is significantly 
large. Our goal is to employ a reduced number of branches and yet 
achieve near-ML or ML performance. The proposed MB-MMSE- 
DF detector selects the best branch according to 



The above expressions only depend on statistical quantities, and con- 
sequently on the channel matrix H, the symbol and noise variance 
a\ and er^, respectively, and the constraints. However, the matrix 
inversion required for computing Wj : i is different for each branch 
and data stream, thereby rendering the scheme computationally less 
efficient. The expressions obtained in Q and ((6} are equivalent and 
only require iterations between them for an equivalent performance. 
Simplifying the equations in ((6) and 0, using the fact that the 
quantity tj — for interference cancellation, Vj t i = 0, and assum- 
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3,11' 



j = l, 



Nt (3) m g perfect feedback (s = s) we get 



where iMMSE(s J [i],to : , i ;,/ ; ) corresponds to the instantaneous 
MMSE produced by the pair of filters Wjj and / ( . The final de- 
tected symbol of the MB-MMSE-DF detector is obtained by using 
the optimal branch: 
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where (5, = [0 . 



is a Nt x 1 vector with a one in 
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where Q(-) is a slicing function that makes the decisions about the 
symbols, which is drawn from an M-PSK or a QAM constellation. 

3.1. MMSE Filter Design 

The design of the MMSE filters of the proposed MB-MMSE-DF 
detector is equivalent to determining feedforward filters Wj t i with 
dimensions Nr x 1 and feedback filters / ; with Nt x 1 elements 
subject to certain shape and magnitude constraints on / ; in accor- 
dance with the following optimization problem 

min MSEfoM, w jih / Al ) = E[\ Sj [i\ - wf tl r\i] + /^S° 
subject to Sjjfj 1 = Vjj and 



J,C L"J I J j,l"3,li' l \ 

/i, I || 2 =7i,j||/Ail| a 



j-l N T -j-2 

the jth element and zeros elsewhere. The proposed MB-MMSE-DF 
detector expressions above require the channel matrix H (in practice 
an estimate of it) and the noise variance g\ at the receiver. In terms 
of complexity, it requires for each branch I the inversion of an Nr x 
Nr matrix and other operations with complexity 0(N R ). However, 
the expressions obtained in (|6) and ((7} for the general case, and in 
i ll lb and i!2t for the case of perfect feedback, reveal that the most 
expensive operations, i.e., the matrix inversions, are identical for all 
branches. Therefore, the design of filters for the multiple branches 
only requires further additions and multiplications of the matrices. 
Moreover, we can verify that the filters Wj,i and / ■ t are dependent 
on one another, which means the designer has to iterate them before 
applying the detector. 

The MMSE associated with the pair of filters Wj t i and / ( and 
the statistics of data symbols Sj [i] is given by 



for j 



, Nt and I = 1, 



MMSE(« i M,io i> ,,/ i ,) = ff2 



wf,iRwj, t + ff,ifj,i 
(5) where <j 2 a — E[\sj [i] | 2 ] is the variance of the desired symbol. 



(13) 



3.2. Design of Cancellation Patterns and Ordering 

We detail the design of the shape constraint matrices Sji and vec- 
tors Vji, motivate their choices and explain how the ordering of the 
data is obtained. By pre-storing matrices for the Nt data streams 
and for the L branches of the proposed MB-MMSE-DF detector, a 
designer can exploit different patterns of cancellation and orderings. 
Specifically, we are interested in shaping the filters f. t for the Nt 
data streams and the L branches with the matrices Sji such that re- 
sulting constraint vectors Vji are null vectors. This corresponds to 
allowing feedback connections of only a subgroup of data streams. 
For the first branch of detection (1 = 1), we can use the SIC approach 
used in the VBLAST and 



Si,if 



3,1 



SjA = 



0, 1= 1 

Oj-i 

0jv T -j+i,j-i 



Int-3+1 



3 = 1, 



,N T , 
(14) 



where m ,n denotes an m x n-dimensional matrix full of zeros, and 
I m denotes an m-dimensional identity matrix. For the remaining 
branches, we adopt an approach based on permutations of the struc- 
ture of the matrices Sj t i, which is given by 

5^/^=0, l = 2,...,L 



»j,i 



where the operator <j>i [■] permutes the columns of the argument ma- 
trix such that one can exploit different orderings via SIC. These per- 
mutations are straightforward to implement and allow the increase 
of the diversity order of the proposed MB-MMSE-DF detector. 

An alternative approach for shaping Sj t i for one of the L branches 
is to use a PIC approach and design the matrices as follows 



OiVx-j+lj-l 
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Sj,i = diag (Sj), j = 1, 



,Ni 



(16) 



The PIC requires the use of an initial vector of decisions taken with 
the feedforward filters Wji. The ordering for the proposed MB- 
MMSE-DF detector is based on determining the optimal ordering for 
the first branch, which employs a V-BLAST type SIC, and then uses 
phase shifts for increasing the diversity for the remaining branches. 
The proposed ordering for 1 = 1, . . . , L is given by 



L N T 



{°1,' 



, Ojv. 



■ T ,i} = arg min V V MMSE( Sj [i], w j>u /.,] 

n, i Oat t Z * ^ * J > 
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(17) 



This algorithm finds the optimal ordering for each branch. For the 
case of a single branch detector this corresponds to the optimal order- 
ing of the V-BLAST detector. The idea with the multiple branches 
and their orderings is to attempt to benefit a given data stream or 
group for each decoding branch. With this approach, a data stream 
that for a given ordering appears to be in an unfavorable position 
can benefit in other parallel branches by being detected in a more 
favorable situation, increasing the diversity of the proposed detector. 

4. MULTISTAGE DETECTION FOR THE MB-MMSE-DF 

In this section, we present a strategy based on iterative multi-stage 
detection 1 1 1 1 1 131 that gradually refines the decision vector, com- 
bats error propagation and improves the overall performance. We 



incorporate this strategy into the MB-MMSE-DF scheme and then 
investigate the improvements to detection performance. An advan- 
tage of multistage detection that has not been exploited for the design 
of MIMO detectors is the possibility of equalizing the performance 
of the detectors over the data streams. Since V-BLAST or DF detec- 
tion usually favors certain data streams (the last detected ones) with 
respect to performance, it might be important for some applications 
to yield uniform performance over the data streams. Specifically, the 
MB-MMSE-DF detector with M stages can be described by 
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M, (18) 



where the MMSE filters ibj t i and f, l are designed with the ap- 
proach detailed in the previous subsection, M denotes the number 
of stages and s°\ [i] is the vector of tentative decisions from the 
preceding iteration that is described by: 



«Z$M = 
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fc = l, 



Nt 



M. 



(19) 



(20) 



where the number of stages M depends on the scenario. 

In order to equalize the performance over the data streams pop- 
ulation, we consider an M-stage structure. The first stage is an MB- 
MMSE-DF scheme with filters Wj,i and f , t . The tentative deci- 
sions are passed to the second stage, which consists of another MB- 
MMSE-DF scheme with similar filters but use the decisions of the 
first stage and so successively. The output of the second stage of the 
resulting scheme is 



Jm+l) 



[i\ = \T W] ,] H r\i] - [Tfj,] 



*a°f*>[i] 



(21) 



where z- ; [i] is the output of jth data stream after multistage de- 
tection with M stages, T is a square permutation matrix with ones 
along the reverse diagonal and zeros elsewhere. When using mul- 
tiple stages, it is beneficial to demodulate the data streams succes- 
sively and in reverse order relative to the first branch of the previous 
MB-MMSE-DF detector. The role of reversing the cancellation or- 
der in successive stages is to equalize the performance of the users 
over the population or at least reduce the performance disparities. 

5. SIMULATIONS 

In this section, we assess the bit error rate (BER) performance of 
the proposed and analyzed MIMO detection schemes , namely, the 
sphere decoder (SD), the linear 0, the VBLAST (SIC) (6), the S- 
DF (7) with MMSE estimators and the proposed MB-MMSE-DF 
techniques without and with error propagation mitigation techniques 
for the design of MIMO detectors. We also consider the lattice- 
reduction aided versions of the linear and the VBLAST detectors |9|, 
which are denoted LR-MMSE-Linear and LR-MMSE-SIC, respec- 
tively. The channels' coefficients are taken from complex Gaussian 
random variables with zero mean and unit variance and QPSK mod- 
ulation is employed. We average the experiments over 100000 runs, 
use packets with Q = 200 symbols and define the signal-to-noise 
ratio as SNR = 10 log 10 NtUs/ct^, where al is the variance of the 
symbols and a^ is the noise variance. 

Let us first consider the proposed MB-MMSE-DF detector and 
evaluate the number of branches L that should be used for a MIMO 
system with Nt = Nr = 4 antennas with 7^; = 0. We also com- 
pare the proposed user ordering algorithm against the optimal order- 
ing approach, briefly described in Section 3, that tests iVr! = 24 
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Fig. 2. BER Performance of the detectors with perfect channel estimation. 



possible branches and selects the most likely estimate. We designed 
the MB-MMSE-DF detectors with L — 1, 2 and 8 parallel branches, 
using one branch with the PIC of l !16t for L > 1, and compared their 
BER performance against the SNR with the existing schemes. The 
results in Fig. 2 show that the MB-MMSE-DF detector outperforms 
the linear one by a substantial margin and is comparable with the 
VBLAST for L = 1. The performance of the MB-MMSE-DF im- 
proves as the number of parallel branches increases, resulting in im- 
provements for more than L — 1 branches. For the case of L = 24, 
we obtain a performance identical to the optimal ML detector and 
for L — 8, we get a performance within 1.5 dB from the optimal 
ML detector computed with the SD. 
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Fig. 3. BER Performance with perfect channel estimates. 



In the next experiment, shown in Fig. 3, we compare the BER 
performance of the proposed MB-MMSE-DF detector with M — 2 
stages, L — 4 (3 SICs and 1 PIC shaping matrices) with perfect 
channel estimation and error propagation mitigation. We include 
in addition to the previous experiment the LR-MMSE-Linear and 
LR-MMSE-SIC detection schemes |9] in the comparison. The re- 
sults depicted in Fig. 3 for a scenario with perfect channel estimates 
shows that the proposed MB-MMSEDF detector achieves a perfor- 



mance which is very close to the optimal ML implemented with the 
SD and outperforms the linear, the VBLAST, the LR-MMSE-Linear 
and LR-MMSE-SIC detectors by a significant margin. 

6. CONCLUSIONS 

We proposed the MB-MMSE-DF detector for MIMO systems based 
on multiple feedback branches. We also proposed the design of 
MMSE filters subject to shape and magnitude constraints and the 
use of multi-stage detection for error propagation mitigation. The 
MB-MMSE-DF detector was compared with existing detectors and 
was shown to approach the ML detector performance. Future work 
will investigate low-complexity design of the filters, channel estima- 
tion and the use for multiuser and multi-cell MIMO systems. 
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